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Abstract. It's well known that the multiquadrics 1)^'^^ (c^ + (3 > 0, and the inverse 

multiquadrics (c^ + ||x|p)^, /3 < 0, are very useful radial basis functions for generating approximat- 
ing functions. However the optimal choice of the shape parameter c is unknown. This question has 
been perplexing many people for many years and is regarded as one of the most important questions 
in the theory of RBF. Hitherto there are very few theoretical works dealing with this topic. Instead, 
sporadic results of experiment can be seen in the literature. The purpose of this paper is to uncover 
its mystery. 

keywords: radial basis function, multiquadric, shape parameter 

1 Introduction 

Before entering the core of our theory, we would like to make a clarification of the definition. We 
are not going to use the simple forms of the multiquadrics and inverse multiquadrics as mentioned 
in the abstract. Instead, we define 



, where is the Euclidean norm of x in i?", T is the classical gamma function and c, /? are constants. 
The function h is called multiquadric or inverse multiquadric, respectively, depending on /? > or 
/3 < 0. The reason of our adopting F is that it will make the Fourier transform of h and our analytic 
work simpler. 

If /? > 0, then h{x) will be conditionally positive definite [8] of order m = [^] where \^~\ denotes 
the smallest integer greater than or equal to ^. If ^ < 0, h{x) is c. p. d. (conditionally positive 
definite) of order m — 0. All these can be found in W. 

For any approximated function /, our interpolating function will be of the form 




(1) 



N 




(2) 



where p{x) G Pm-i, the space of polynomials of degree less than or equal to m — 1 in i?", X = 
{xi, ■ ■ ■ ,xn} is the set of centers (interpolation points). For m = 0, Pm-i ■= {0}. We require that 
s(-) interpolate /(•) at data points {xi, f{xi)), ■ ■ • , {xn, /{xn))- Therefore a linear system of the 
form 

N Q 

Cih{xj -Xi)+Y biPi{xj) = f{xj), j = !,■■■ ,N (3) 



and 



N 



Yc^pj{x,)^0 , J = i,...,g (4) 



i=l 



, where {pi, ■ ■ ■ ,pq} is a basis of Pm-i, has to be satisfied. Since h is c.p.d., this requirement will 
be theoretically satisfied [8]. However if c is very large, h will be numerically constant, making 
the linear system (3), (4) numerically unsolvable. Moreover, if c is very large, the coefficient matrix 
of the linear system will have a very large condition number, making the interpolating function s 
unreliable when f{xi), • • • , /(xn) are not accurately evaluated, as pointed out by Madych in 

Our approach for choosing c is based on Theorem2.4 and Corollary2.5 of 4 which we will cite 
directly but make a slight modification to make them easier to understand. 

Before introducing the main theorem, we need some fundamental definitions. Let 2?(_R") denote 
the space of complex- valued functions on i?" that are compactly supported and infinitely differen- 
tiable. For any integer m > 1, let 

Vm = {'pe ^(i?") : J x°'ip{x)dx = for all \a\ < m}. 

If m 0, X>™ :=2?(i?"). 

Definition 1.1 Let h he as in (1) and m = max{0, [|]}. We write f e Ch,m{R'') if f e C{W) 
and there is a constant c{f) such that for all ip in 'Dm, 

1/2 



f{x)ip{x)dx < c{f) i^j J h{x- y)ip{x)ip{y)dxdy | . (5) 

// / G Ch.miR^^), we let \\f\\h to denote the smallest constant c{f) for which (5) is true. 

The function space Ch,m{R^), abbreviated as Ch,m, is called native space whose characterization 
can be found in , [3] , [5] , [5] and [5]. 

Definition 1.2 For n = 1,2,3,---, the sequence of integers 7„ is defined 6?/ 71 = 2 and 7„ = 
2n(l +7„_i) ifn>l. 

Definition 1.3 Let n and (3 he as in (1). The numhers p and Aq are defined as follows, 
(a) Suppose /3 < n — 3. Let s — |" "~^~-^ "| . Then 
(i) z//3<0, p=3±£„„rfAo = i^±2i^W. 
(U) z//3>0, p=l + ^ and Ao = (2"'+^+^)(2;;+i+^)-(2"'+3) 
where m — \ ^~\. 
(h ) Suppose n — 3<f3<n — 1. Then p = 1 and Aq = 1 . 
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(c) Suppose P>n-l. Let s = - [ "~^~^ ] . Th 



en 



0=1 and An = -. r-. ^ -. r where m = [—1 . 

^ (2TO + 2)(2m+l)---(2m-s + 3) '2' 

Theorem 1.4 Let h be defined as in (1) and m = max{Q, Then given any positive number 

bo, there are positive constants Sq and A, < A < 1, which depend completely on 69 and h for which 
the following is true: For any cube E in R" of side length bo, if f € Ch,m and s is the map defined 
as in (2) which interpolates f on a finite subset X of E, then 

■1+3+1 



\fix) - six)\ < 2^^7: — y^c^VAoiX)^\\f\\h (6) 

holds for all < S < Sq and all x in E provided that 6 = d{E,X) := supj,^^ infjjgx |?/ ^ 2^1- Here, 
an denotes the volume of the unit ball in i?", and c, Aq were defined in (1) and DefinitionLS 
respectively. Moreover 6q = gg-y (m+i) ' '^'^^ ~ (|)^^^ where 



C 



max|2p'V^e2"^", |-| , p' = ^. 



The integer 7„ was defined in Definition 1.2, and \\f\\h is the h-norm of f in Ch.m, as defined in 
DefinitionLl. The constant p was defined in DefinitionLS. 

Remark: Theorenil.4 is cited directly from |4j with only a slight modification. The proof is very 
technical. The main contribution of the theorem is that it uncovers the mystery of A and Sq whose 
values were unknown. Both numbers appear in the currently used exponential-type error bound 
for multiquadric interpolation which was only an existence theorem. Obviously the domain E in 
Theoreml.4 can be extended to a more general set il C i?" which can be expressed as the union of 
rotations and translations of a fixed cube of side 60 • 

In (6) it's clearly seen that the error bound is greatly influenced by the shape parameter c. 
However, in order to present useful criteria for the choice of c, we still need a few theorems. 

Definition 1.5 For any a > 0, the class of band-limited functions f in L^{R") is defined by 

= {/ e L\R-) : /(O - if Id > a} 
, where f denotes the Fourier transform of f . 

Theorem 1.6 Let h be as in (1) with /3 > 0. Any function f in belongs to Ch.m o,nd 

WfWh < ^/m\S{m,n)2-'''"-i^n-''-ia"-^e'^c^\\f\\L^R^) (7) 

where c, (3 are as in (1) and S(rn,n) is a constant determined by m and n. 

Proof. We are going to show B^ C Ch,m by Corollary3.3 and Theorem5.2 of [6]. 

Let m = [^] . Then the requirement a^ = Q for all I7I = 2m in Corollary3.3 of [6] is an immediate 
result of Theorems. 2 of fB]. Since B^ C L^(_R"), any / e B^r is a member of S' where S denotes the 
Schwarz space. Now, let p(^) be the Borel measure mentioned in Corollary3.3 of [6 . By (3.9) of |6j, 
it suffices to show that 



1/2 



3 



for all / e Be,. We proceed as follows. 

1/2 



y.\—m 

y.l—m ^ 

,^1/2 J 1 /■ ^2a|j(^)|2 1 ^ I .3 r/ieoreTO5.2 0/ [6]) 



1/2 

J y ^ / I (5y rWem8.15 0/ iSj) 

I «! A" ICP™ 2i+4(M)-4-f/c^(c|f|) I 



1/2 



< -^.2-(Hl)|5(m,n) / |/(^)|2 . . w/iere ^(m, n) denotes i/ie 

number of terms in the " " 

1/2 



< V^I^.^^lf mm^-^^dA' (by CoroUary5.12 of M) 



(27r)"22 



< 00. 

Thus B,, C Ch,^ and (7) follows. tt 

If in (1) /? < 0, the norm || • is defined in a slightly different way. Hence we handle it separately 
and present the following theorem. 

Theorem 1.7 Let h be as in (1) with /? < such that n + (3 > I or n + f5 = —1. Any function f 
in Ba- belongs to Ch,m and satisfies 

11/11. < 2— ^a^e^c^||/|U.(«„). (8) 

Proof: If ^ < 0, then h is conditionally positive definite of order m = [5]. By Theorem5.2 of [B], 
we know that in Corollary3.3 of [B] a-^ = for I7I = 2m. Obviously any / G B„ belongs to S' since 
/ e L?[R^^). In order to apply Corollary3.3 of [B] to show that B^ C Ct^m, it remains to show that 
f G Ba implies / e L'^{p) where dp(^) r{(_)d£_ = as stated in [6]. 
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Now, let / e Ba- By (3.9) of [B', it suffices to show that := |1/|1l2(p) < oo. We proceed as 

foUows. 



< 



< 



< 



1/2 



|/(OP(27r)-2" 



1/2 



1/2 



> where w{-) = h{-) by Theoremb.2 of |B] 



1 



|/(e)P(27r)-2"2"i-|(M)^. 

c (c|£| ) 



1/2 



by (8.7), p.109 0/ [g 



•1 + /3 



1/2 



^rr^dC > if \n + I3\> 1 by Corollaryb.U 



-2n„-2n-i „i- 



1 1 .i + ,8 



2 (-2 2 



1/2 



zn^ 



-2n_-2n- 



1 + i 

2 <^ 2 2 rr 2 



|/(0|'e^l«ldn z/n + /3 + l>0 



1/2 



-1-8 1 n + g + 1 1 n + ^„ 



1/2 



\i\<c 



/ Q-i-'^^n i±£±i iz±i±« 

< 2 -1 TT 4fT * C •* 6 2 ||/||L2(fl") 

< CO 



In the preceding deduction we put the restriction |n + ^| > 1 on it. This is a drawback because 
the frequently seen case n — 1 and /? = — 1 is not covered. This gap will be discussed shortly. 

Corollary 1.8 For any positive number a and any function f £ B„, under the conditions of Theo- 
reml.4, 

|/(x) - s{x)\ < v/m!5(m,n)(27r)-T^/^(ji^yA;;c^^e¥(A)7||/||i2(fl„) (9) 

if n -\- P > 1 or n + (3 = —1. The number S{m,n) is determined by m and n, and is one whenever 
/3 < 0. The other constants are as in Theoreml.4- 



2 How to choose c? — a more practical approach 

In (9) the only things influenced by c are , e^ and (A)^. The number S is the famous fill 

distance of the data points, as explained in Corollary2.5 of [4]. The constants /3, a are defined in 
(1) and Definitionl.5 respectively. Theoretically (A)^ is very influential. However it contributes 
little to the error estimate in practice due to two reasons. First, A is quite large and near one 
as shown in Theoreml.4. Second, 6 can not be very small(near zero). As shown by Madych in 
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[7], whenever S is too small, the condition number of the linear system (3), (4) will be very large, 
making its solution meaningless. Note that 7„ oo very fast as n — ^ oo. The first examples are 
7i =2, 72 = 12, 73 = 78 and 74 = 632. Thus A reacts to the change of c very slowly. The number 
A will become small enough to make (A)^ influential only when c is extremely large. For example, 
if the dimension n ~ 2 and the domain cube E has side length bo = I, then 

where 



C = max |2p'V2e^^% ^| : P' = 72 - 12. 



The number p is equal to one or a bit larger than one, depending on /3. Thus C is usually very large 
and A is near one, unless c is very large. 
Another problem is that the function 

will in practice make the linear system (3), (4) numerically unsolvable whenever c is too large. In our 
preceding example all centers(interpolation points) lie in the cube of side 1. Therefore jx^ — Xjj < \/2. 

If our computer allows seven or fourteen significant digits, then h{xi — xj) will become r(— ^)(c^)^ 
whenever c > 10'' or lO"^. In our example A > and is near one even when c = 10^^. Therefore 

(A)^ is only theoretically influential and can be ignored in practice. What's in practice influential 
IS c 4 and e 2 . 

In this section we assume that /3, 60 (the side length of the cube), and S are fixed and m — 
max |o, [^] I as in Theoreml.4. The optimal choice or suggested value of c is presented according 
to the values of /3, n, tr, S, and 60 • 



Casel 



/3 + 1 — n > Let / e Be and be a cube in i?" with side length bo as in Theoreml.4. Let 
h be as in (1) with n + (3 > 1 or n + f3 = —1. Let < S < (m+i) fixed in Theoreml.4. Suppose 
/3 + 1 - n > 0. Then 

(a) the optimal choice of c is to let c = 12pY^e^"'^"7n(m + 1)^ if n 7^ 1 or /? 7^ 1, where p 
and 7„ were defined in Definitionl.3 and 1.2 respectively; 

(b) the optimal choice of c, when n — 1 and /3 = 1, is as follows. Let ci — 12p-yne^"'''"7„(m + 
1)6, Co = 3606^^, and 77 = Then 

(i) choose c = 12pV^e2"^"7„(TO + 1)^ if f + 77 > 0; 

(ii) if § + < and ci < < co, choose c ~ ci if H{ci) < H{co) and c = cq 
if H{co) < H{ci) where H{c) := cie^i^)^^; 

(iii) choose c = 12/9y^e^"'''"7„(m + l)(5if§+?7<0 and cq < ] 

(iv) choose c = coif§+77<0 and ^^^jji^^-^ < ci . 
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Reason: This is a consequence of (9). However in order to satisfy the condition S < Sq in Theo- 
reml.4, wc put the restriction 5 < 4^, (m+i) froni the beginning. The number 4^, (m+i) ''^^^^ 
obtained by letting C = when c = Sboe'^. Increasing c(i.e. c > 36oe^) does not change Sq, but 
decreasing c(i.e. c < 36oe^) makes So smaller. After < S < 4^ (m+i) fixed, c cannot be less than 
12p-yne^"''''''7„(m + 1)5 because of the restriction 5 < 6o- 

(a) follows from (9) obviously because (A)^ can be ignored and the only thing influenced by c is 



c 4 • e~ . The smaller c is, the smaller the error bound (9) is. 

(b) is more complicated. Although we previously mentioned that (A) « can be ignored practically, 
there is an exception. When n — 1 and 13—1, A is not very large and S is not required to be very 
small. Therefore the influence of (A) ^ has to be taken into consideration. 

For n = 1, 13 = 1, let 



H{c) := c 



-e^(A)< 



c^e 2 I - 



C4e 2 (3)^ 

J. CCT /Ox 



if c > 3boe^ 
if c < 36oe^. 



iJ(c) is increasing on [36oe^, 00). For c G (0, 36oe''], 



c*e 2 



c^e 2 e'''' where rj :- 



Ini 

— ^ < 



Then 



H'{c) 



e 2 



(f+'?)c 



4+" 



(f 



If I + > 0, then -ff'(c) > and H is increasing on (0, 36oe^]. In this situation the optimal c is 
naturally the minimal possible choice c = 12/9\/ne^"'''"7„(m + 1)5. 



Assume § + < 0. Then iJ'(c) = iff c 



c < c*. Our criteria (ii), (iii) and (iv) thus follow immediately. 



H'{c) < if c* and H'{c) > if 



Remark: (a)In Casel(b)(i) the error bound goes to inflnity as c ^ 00. (b)The numbers p and 
7„ are defined in Definitionl.3 and 1.2 respectively. 



Case2 



P +1 — n <Q Let f ^ B„ and be a cube in i?" with side length ho as in Theoreml.4. 

1. If < (5 < ... ^Z.,,, in Theoreml.4 is flxed and 



Let h be as in (1) with n + /3>lorn + /3 — — ±. ±1 u ^ u 47 (m+i) 
/3 + 1 — n < 0, the optimal choice of c is to let c = max | "~2o-~^ ' 12p\/ne^"'>'''7n(m + l)5|where 
m, 7„, and p are defined as in Definitionl.l, 1.2 and 1.3 respectively. 



Recison: In (9) (A)^ can be ignored. The only things influenced by c are c 4 and e 2 . Let 
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g{c) :— c 4 6 2. Obviously 5(c) — > cx) as c — > 0+ or c — > cx). The minimum of g occurs when 
g'{c) = 0. Now 

, , , B + 1 ~ n fl-rz-3 fl+l-n 

g [C) = C 1 6 2 +c * -6 2 

cCT. f /3 + 1 — n fi-n-3 a g+i-n 
4 ^2 



g'{c) = i// c 4 +-6 4 

cr 3+1-.^ 3-..- 

*// 77^"= : c 4 

2 4 



4(7 /3-n-3 n-3-1 



2(n-/3- 1) 

2(7 

n - /3 - 1 



2(7 

In order to meet the requirement S < Sqih Theoreml.4, we set 6 < 4^ (m+i) '^hich is the Sq ob- 
tained by letting C = As c decreases, i5o will also decrease. The acceptable domain of e is then 
[12py^6^"''''"7„(m + 1)6, 00). Therefore we choose the maximum of the two values as the optimal c. 

Remark: (a)Case2 includes the well-known cases (3 — 1, n > 3. (b)Note that in Case2, the 
upper bound of \f{x) — s{x)\ goes to infinity if 6 — ;> cxi or 6 — > 0+. 

In both Casel and 2, we require |n -I- /3| > 1. This is a drawback. The worst thing is that the 
frequently seen case /? = — 1, n = 1 is excluded. For /3 = — 1, it's just the inverse multiquadric 
h{x) = —j=3J=. For such h{x), Casel and 2 only deal with n > 2. If n = 1, we need special 
treatment which is absolutely nontrivial. 

Lemma 2.1 Let h be as in (1) with (3 = —1, n = I. For any a > 0, if f (z B^, then f G Ch.m o,nd 
||/IU<(27r)-"2-4 -1- / |/(e)p(fe+- / l/(0Py^e^l«ld4 (10) 



if - < a, where an = -^^^ttt-, and 
J c ' ^ 2r(i) ' 



1/2 



11/11. <(2.)-"2-.|^^^^^J/(OP.e| (11) 



Proof. By (3.9) of [6 , ||/||„ = ||/|U2(p) and 
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if |/(OP(27r)"^" ■ where w{-) = h{-) by Theorem5.2 of M 

1 /2 

11^^ |/(OP(2^)^^"2-^ . ^^^rf?} by (8.7) o/ ^^.109) 



1/2 



/Co(l) 7|f|<i ao J|f|>i 



^o(l) J|e|<i ao y|5|>J 

6y Corollary5.12 of |5] and p. 37 A of \1\ where qq 



2r(i)V3' 

Since /(^) = for |^| > cr, our conclusion follows immediately. jj 

Lemma 2.2 For any positive number a and any function f G B^, under the conditions of Theo- 
reml.4 with j3 = —1 and n = I, 

1/2 

|/(x)-s(x)|<V2^V^(A)^|A±J^| (12) 
2V3r(i) 



where A = ^4|<i IfiOl'd^ B = /,^|^|^^ V^e^'^'rfC ^f \ < a and B = Q ^f 

i > a. 

c — 

Proof. This is just an immediate result of Theoreml.4 and Lemma2.1. jj 
With Lemma2.1 and 2.2 we can now begin to analyze the appropriate choice of c. 



CaseS n — 1, (5 — —\ Let / e B^ and i? be a cube in i?" with side length bo as in Theoreml.4. 

Let h be as in (1) with n — 1, 13 — —1. If < ^ < min {24^^, ^} in Theoreml.4 is fixed, under 
the conditions of Theoreml.4, the suggested choice for c is to let c = i. 

Reason: As pointed out in the beginning of this section, the number (A)^ in (12) can be essentially 
ignored. Hence the only thing in (12) influenced by changing c is Note that if c S (0, i], then 

S = 0. We define Hi{c) = ^ if c e (0, i] and H2{c) = if c € [i, 00). Then 



- "-^ ^ Ml) * ' Miyi'^i^"-" = 



Now, for c e (0, i]. 



hm Fi(c) = \im f IfiOl^d^ 

C-S-0+ c^0+ c/Co(l) J|f|<i 



c->-0+ 

1 

;6+ cMi) 

00 



= 1™, tp-tttII/I" 
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For cG [i, c5o), 



lim H2{c) 

c—^oo 



c~>oo c I /Co(l) y|^|<i 



1 

< lini — 

c— >C30 c 



ml 



2V3r(i 



2V3r(i; 



/Co(l) 



Ji:<\i\<a 



l/(OlVc|?|e^l«lde 



By the structure of the integrands, we know that m fact Unic-yoo ^^2(c) — cxd, not just < oo. 

Therefore, the upper bound of \f{x) — s{x)\ in (12) goes to infinity as c — > 0+ or c — > oo. This 
phenomenon together with the agreement of Hi and H2 at ^ suggests that c = ^ is a safe and 
natural choice. 



Remark: (a) In Theoreml.4 we require that S < Sq where — 0+ as c — >■ 0+. If <5 is fixed, 
c cannot approach arbitrarily. Note that for n = I, /3 = — 1, 
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if c < 3&oe* 
if c > Sboe'^. 



The requirement S < 2^ is equivalent to 24e^S < c. Therefore our exploration is in fact restricted 
in the range c G [24e''(5, 36oe"'] U [36oe^, 00) = [24e^(5, 00). This is a drawback. However the 
assumption 5 < min { jiji^; ^} ™ CaseS guarantees that {1)6 < So for our final choice c = i, and 
S <Sq for all c G [2Ae% 00) and {n)24e^S < i. If c < 2Ae'^d, then S < Sq does not hold and (12) 
may not be true. Therefore in CaseS c = i is just a suggested value, and we know that the smaller 
i5 is, the more reliable our choice c = ^ is because 2Ae^6 as 5 — ^ and limc_>.o+ Hi{c) = 00. 

(b) As in the case n — 1, (3 — l(Casel), the number A may not be very large when n — 1, (3 — —1. 
Therefore it seems that in CaseS the influence of (A) « should be taken into consideration. However 
we put it into Case6 of subsectionS.l because it's meaningful and useful to see what will happen 
when (A)^ is ignored. 

Remark: All the criteria provided in this section are based on Theoreml.4 where we require that 
S < So- Note that So '■= 6C7 (m+i) ^® usually a very small number. Most time C = "^p^^ — — where 
p = 1 or a bit greater than 1. For such C, 

S<Soiffc> [12pV^e2"^"7„(m + 1)]S. 

li S — 0.125, n ~ 1 and m ~ 1, then p ~ 1 and c > 6e'^. The lower bound of c increases rapidly as 
n increases, li S — 0.125, n = 2, m — 1, then p = 1 and 

c > S6V2e''^ > 36V2(2^°)'^ > SGv^lO^^ 



which will make the linear system (S),(4) numerically unsolvable because c is too large. Since 
7„ — > 00 very fast as 71 —> 00, the minimum requirement for c will become extremely stringent for 
high dimensions. On the other hand, as is well known by RBF people, ill-conditioning will happen 
whenever the fill distance is small. Therefore the restriction (5 < (5o is a big problem. Madych's 
experiment [7] shows that when the domain size bo = S, and n — I, the condition number is already 
too large iiS — 0.125. Of course So can be increased by increasing c. However the linear system (S),(4) 
will become numerically unsolvable when c is too large. Moreover, the condition number also grows 
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when c increases as Madych[7] shows. Therefore, our criteria are stih quite theoretical sometimes. A 
possible way of making things simpler is to decrease S so that the choice c = 12p-\/ne^"'''"7„(m + 1)6 
will be acceptable. Although small S will result in a large condition number, this trouble can be 
coped with by the infinitely precise Mathematica, or by making /{xjYs in (3) completely accurate. 



3 How to choose c? — a more theoretical approach 

In section2 we took into consideration the problems of ill-conditioning and numerical unsolvability 
of the linear system. Therefore (A)^ in (9) and (12) was not taken into consideration. Theoretically 
S can be arbitrarily small and hence | cannot be ignored. Moreover, A can be very small if the 
side length bo of the cube is very large and c is very large. Consequently (A) 7 is theoretically very 
influential and highly depends on c. In this section the effect of (A)' is taken into consideration and 
more theoretical criteria are developed. We divide the section into two parts. 

3.1 6o fixed 

We first deal with the situation when the domain i? is a cube of fixed side length Bq. 
Note that in Theoreml.4 



C = max|2p'v/;ie2"'^", ^] ^ p' = f • 



Also, 2p'^/ne 



2"7„ if and only if c = ib^p^e^'^^^ . Let cq := S^oPv^e^^T". Then C 

2/9' v^e^"^" if c e (0, Co], and C = gf^ if c € [cq, oo). For c e (0, cq]. 



A7 = 



2 \ ec-,„6 

3 
2 
3 



2\ 

3. 

ri{6)c 



where ri(6) < is some number depending on 5. In fact rj[5) := ]^2pV""^" 
the part infiuenced by c is c'^ e^(A)^ — g[v{S)+^\c_ 



In (9), for c G (0, cq] 



Let's define Hi{c 
For c € [co, oo), we define H2(c) 

2 

36o 



c^^^i-^e[''('^)+^l'= for c e (0, cq]. 

1 + 



Note that C > if c e (0, cq] and C 



Now let 



3fco 



e— (A)7 where A = (|)'3C7„ = (f)"^ 
if c e [co, oo). 



H{c) 



Hi{c) ifce(0,co] 
H2{c) if c e [co, oo). 



Then minimizing the error bound (9) is equivalent to minimizing H(c). 

The function H(c) is continuous and satisfies Hi{cq) = i?2(co)- Theoretically, c* is the optimal 
choice of c if Hie*) is the minimum of H. 
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Casel 1 + /3 - n > and 



ri{5) + § > Let f G B„ and E he a cube in i?" with side length bo 

as in Theorenil.4. Let h be as in (1) with n + (3 > 1 or n + /3 = ~1. For any fixed < 6 < 4^ (m+i) 
in Theoreml.4, ifl+/3 — n>0 and rj{S) + ^ > wlicre ri(S) is defined as in the beginning of 3.1, 
the smaller c is, the better it is. Since there is a requirement 6 < 60 in Theoreml.4, c cannot be 
arbitrarily small. The optimal choice of c is then 



12,9V«e2"T"7„(m+l)(5 



since 6 < 5q implies 12p\/ne'^"''^'"yn{'m + 1)6 < c and H{c) is increasing. 

Remark: (a)Usually ri{6) ss in practice since S cannot be very small. Hence ri{6) + § > 
visually holds. (b)Before c is given, Sq is unknown. The number Sq changes with c only when 
c < Co := 'dbop^/ne'^"''^"^ , and (Jq — > 0+ as c — J- 0+. Therefore we require in advance that 6 < 



bo 



where 



bo 



47„(m+l) 

is just the So when c = cq. The requirement 5 < is a drawback and we have in 
fact investigated c only in the range [12/9-yne^"'''"7„(m + 1)6, 00). However the smaller 6 is, the 
more meaningful our optimal choice of c will be. 



47„(m+l) 



Case2 1 + /3 — n > and T]{d) + ^ < Let f € B„ and E he & cube in i?" with side length 60 
as in Theoreml.4. Let h be as in (1) with n + ^>lorn + ,9 = — 1. For any fixed Q < 6 < 4..y„('^_|_i) 

> and ??(^) + f < where 7? (5) is defined as in the beginning of 3.1, the 



in Theorem 1.4, if 



optimal c is chosen as follows. 

Obviously H{c) is increasing on [cq, 00). Therefore the minimum of i?(c) happens in the interval 

[12pi/ne^"''''"7„(m+l)5, Cq] under the assumption 6 < (m+i) ■ closed interval H{c) = Hi{c) 

and Hi{c) = iff c = =: c*. Moreover, H[{c) > if c < c* and H[{c) < if c> c*. Therefore, 

(a) mincg(o,oo) -ff(c) = min{_ffi(c): c = 12pv^e^"'''''7„(m + 1)5 or 36oP\/ne^"'^''(= cq)} if 

c* € [12pv^e2"''"7„(m+ 1)(5, cq], 

(b) mincg(o,oo) H{c) = Hi{co) if c* < 12p^e^"^'''"jn{m + 1)6, and 

(c) minee(o,oo) H{c) = J?i(12pV^e2"T''7„(m + 1)6) if c* > cq. 

The optimal choice of c is then where i?(c) is minimal. In other words, let 
if c* > Co, and I c = cq I if c* < 12p\/ne^"'''"7„(m + 1)6, and so on. 



Remark: (a) Seemingly this criterion is complicated. However in practice 6 cannot be very small. 

Therefore ri{S) is near zero and the situation ri{6) + ^ < rarely happens. (b)In this case although 
we wrote c S (0,oo) for simplicity, in fact we only investigated c G [12p-yrie^"'''"7„(rn + 1)5, 00) 
because of the restriction 6 < 6o- This kind of situation will appear again subsequently in the text. 



Cases 



1 + P^ 







and 



77 



f <0 



Let / e Bcr and _E be a cube in i?" with side length 60 

as in Theoreml.4. Let h be as in (1) with n + P > lorn + /3 = — 1. For any fixed < 6 < 4^„('^_|_i) 
in Theoreml.4, ifl + /3 — n = and r]{6) + ^ < where r]{6) is defined as in the beginning of 3.1, 
the optimal choice of c is 



c = Sbopy/ne^"^" . In other words, we choose c = cq. 



Reason: By the definition of H{c), it's obvious that in this situation H is decreasing if c < cq 
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and increasing if c > cq. Our criterion thus follows. 



Case4 1 + (3 — n < and 77 + f > Let f e B„ and be a cube in i?" with side length 60 



as in Theoreml.4. Let h be as in (1) with n + /3> lorn + /3 = — 1. For any fixed < 5 < 4^ (m+i) 
in Theoreml.4, ifl + /3 — n<0 and r]{6) + f > where r]{S) is defined as in the beginning of 3.1, 
the optimal c is chosen as follows. 

By the definition of H, \im^_^Q+ H{c) — limc_j.oo H{c) = 00. 



H[{c) = ■ e^^+i^'^ ■ 



n- 1-/3 



= Oiffc = 



4(7?+ f) 



=: ci. 



So 



min H{c) 
ce(o,co] 



-ffi(co) if ci > Co, 

ffi(ci) if 12pV^e2"T''7„(m + 1)6 < ci < cq, 

ifi(12/9V^e2"T"7„(m + 1)^) if a < 12p^e^''-<"jnim + 1)5. 



Now, 



So 



„i , ^ M-o-.. ^ ^ I (J n — 1 — B\ OCT n— 1 — /3 
ff^(c) = c^A^ ( -c ^ j e- = i// c = 2^ =• C2 



min J?(c) 

cS[co,C!o) 



F2(Co) if C2 < Co, 

^^2(02) if Co < C2. 



These give 



min H{c) = min < min H{c) 
ce(o,oo) tce(o,co] 



min H{c) 

ce[co,oo) 



The optimEil choice of c is then where the minimum of H{c) happens. 



Case5 1 + i — < and 77 



I < Let f G Ba and be a cube in ii" with side length 60 

60 



as in Theoreml.4. Let h be as in (1) with n + /3> lorn + ^ = — 1. For any fixed < S < 

in Theoreml.4, if 1 + /? — < and ri{S) + ^ < where ri{5) is defined as in the beginning of 3.1, 



the optimal c is (i)c ■ 



2(7 



if Co < 



2(7 



or (ii)c = Co if 



2(7 



< Co. 



Reason: In this case H{c) is decreasing on (0, cq]. Then wc have the following two cases, (i) Assume 
Co < "~2j~^ ■ On [co, 00), i?'(c) = iff c = ^^-g^^- is decreasing on [co, -^^-53-^] and increasing 
, 00). (ii)Assume "'~2~^ < cq. Then H'{c) > on [co, 00). The optimal choice thus 



on 



rn-l- 



2(7 



follows. 



Remark: Up to now we always put the restriction 7i + /3>lorn + 
The frequently seen case n = 1, /3 = — 1 still has to be treated. 
We analyze this case as follows. Note that when n = 1, /3 = — 1, 



= — 1 on the criteria. 



C 



^ ifce (0, 3boe% 
ifce[36oe^ 00). 
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There is a restriction 5 < So = 6C7 (m+i) ~ T5c" ^ ~ 35^' '^0=8- For any fixed S < So 

decreases as c decreases in (0, 3boe'^]. In order to satisfy 5 < Sq, the minimal choice of c is 24(5e^. 
In the domain c S [24:de^, 3boe^], (A) J is a decreasing function of c, and 



(A)' = 



if c = 24(56^, 



if c = 36oe^. 



This fact together with hmg_>o+ -f^i (c) = 00 in CaseS of section2 suggests that letting c — )• 0+ should 
be avoided and the smaller S is, the more obvious this criterion is. 

Now let's investigate the behavior of the error bound when c G [36oe**, 00). In this case C, and 
hence A, is fixed. Therefore (A)? is independent of c. As in CaseS of section2, limc_>.oo H2{c) = 00. 
Letting c — > 00 should also be avoided. 

In Case3 of section2 the suggested value of c is i when (A)« is not taken into consideration. 
Now, as mentioned above, (A)i is a decreasing function of c on [24(5e'*, 36oe^]. If 36oe^ < i, we 
suggest the choice c—^. However if ^ < 36oe^, the crucial part i?2(c) of the error bound tends 



to be increasing for c€ 3boe^], but (A)^ is decreasing for c e [^, 36oe^]. They off'set each other. 
Note that if 6 is very small, (A) 7 will be influential. Therefore we suggest that c = Sfeoe'* if S is 
very small and ^ < 3boe^, and c = ^ if J is not very small and ^ < 36oe^. In order to make 5 < So 



when c = ^, we set S < ^j^- 

We summarize our discussion as follows. 



Case6 



and 



Let f G B„ and be a cube in i?" with side length bo as in Theoreml.4. 
1, /3 = -1. For any flxed < ^ < min{24i^, ^} in Theoreml.4, the 



Let h be as in (1) with n 
suggested value of c is as follows. 

(a) c=iif36oe4<i. 

(b) c — 3boe^ ^ — 3&oe^ and S is very small; c = ^ if ^ < 36oe^ and S is not very small. 

Remark: In Case6 only suggested values, rather than optimal values, of c were provided. The 
main reason is that in the crucial parts i?i(c) and 1^2 (c) of the error bound, as in CaseS of section2, 
the integrals involve the Fourier transform of the approximated function / whose value cannot be 
controlled. 



3.2 bo not fixed 

Recall that in Theoreml.4 the crucial constant C is defined by 




The number C is independent of c whenever c G [Sbopy/ne'^"'^'' , 00). Therefore increasing c does 
not influence (A)^ in (6) and (9) whenever c is large enough. However this situation will be totally 
changed if the side length 60 of the cube is not fixed. In some domains any point is contained in a 
cube of side length 60 where 60 can be made arbitrarily large and the cube is still contained in the 
domain. For example, 

n := {x = {xi, - ■ ■ , Xn) : Xi >0, i = 1, • • • , n} 
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or Q = R". Madych calls such domains invariant under dilation in j^. For such domains one can 
keep C = ^"^^ by increasing 60 when necessary. (We never decrease 60 because it will make the 
error bound worse.) Thus C and (A)^ are influenced by c even when c is very large. We consider this 
phenomenon to be only theoretically meaningful. Note that 2p' y/ne^^''^ = usually happens only 
when c is extremely large. In practice the linear equations (3), (4) will become numerically unsolvable 



and ill-conditioning will happen when c is too large. Most time C = 
we don't need to increase bo to keep C 



automatically and 



2py/ne 



The word domain should be further interpreted so that ambiguity can be avoided. In this paper 
the interpolated function / belongs to and therefore is defined on the entire R". However in 
practical problems often interpolation can be done in a subset n of i?". The centers(interpolation 
points) are in J7 only. Here we call the set il domain too. 

In (9) the part influenced by c is then theoretically 



c 4 



e"^ ■ (A) « 



c * -62 



2\ 12pv^c2nT.„ 



2\ 12p^e-'"-ln~,„5 



where 



We analyze as follows. 



2\ TwsJ^'^^f^^'T^ 



Casel /3 + 1 — n > and H{a, 5) >1 Let f e Ba and C i?" such that for any x in 
and any 60 > there is a cube E of side bo satisfying x £ E C fl. Let h be as in (1) with 
n + f3 > lorrt + /3 = — 1. For any fixed (5 > in Theoreml.4, the optimal choice of c is to let 

c — 12p7„(m + l)(5-yne^"^" where m — max|o, [§] | denotes the order of conditional positive 
definiteness of h, and 7„ is defined as in Definitionl.2. 



Reason: In this case the error bound (9) tends to zero as c — >■ 0+. However Theoreml.4 re- 



quires that d < Sq where So 



C 



2p^/ne 



12pV"e2"Ti»7„(m+l) 



because bo can be made arbitrarily large to keep 



Therefore the minimal possible choice of c is 12p7„(m + l)5^Jne'^'^^''' . 



Remark: Now, for any 5 > 0, we can always choose c and bo making (5 < in Thcorcml.4. 



In fact, for any (5 > 0, choose 60 large enough such that 5 < So '■— 



where C 



6C7„(m+l) 

The relation 5 < 5o can be maintained by increasing 60 and choosing c > 12p^n\/ne 



2 



Then 
1)<5. 



Case2 (3 + I — n < and H{a, ^) > 1 Let / e B^ and Q C i?" such that for any x in and any 



60 > there is a cube E of side bo satisfying x £ E C fl. Let /i be as in (1) with n + /3 > 1 or 
n + (3 — —1. For any fixed 5 > in Theoreml.4 the optimal choice of c is to let 



Co 



if c* ~ ^ 
if Co < c* 



-1-/3 



< Co 
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where Cq := 12pv^e^"'''"7„(m + 1)^ and r/ is a positive number defined by r/ := ^ + i2pv^"^"-vn-y ,; • 

Reason: It's easily seen that in this case [H{a,6)]'' oo both as c — > 0+ and c —J- oo. 

Since H{a,S) > 1, there exists a positive number r] such that H{a,6) = e^. By the definition of 

H{a,S) we easily get ry = f + i^^./;^^^"^.!-^^^ - Since C = ^E^^ — — and there is a requirement 



(5< ,5o = 



2 ' 12pyne2"T-»i7„5 • 

Yj in Theoreml.4, the minimal possible choice of c is cq 12p-yne^"^"7„(m + 1)(5. 

G"(c) < if c < c* and G'(c) > 



Let G(c) := [i?((7, 5)]^ Then G'(c) = iff c - -* — ""^ 



4r; 

if c > c*. In the domain [cq, oo) the minimum of G(c) happens at cq if c* < cq, and at c* if c* > cq. 
Our criterion thus follows. 



Remark: The case /3 + 1 — n < and H{a, 6) 
is. 



1 is trivial. The larger c is, the better it 



Cases 



P+l-n>0 



and 



H{a, 6) < 1 Let f ^ and O C ii" such that for any a; in O and any 



6o > there is a cube E of side ho satisfying a; e S C f2. Let h be as in (1) with n + /3 > 1 or 

n + /3 = —1. For any fixed 5 > in Theoreml.4, the error bound in (9) goes to zero both as c ^ 0+ 
and c — >■ oo. However the minimal possible choice of c is 12py/rie^"'^" jni'm + l)S. 



-[H{a,5)Y both as c 
as in Case2 the requirement S < 6o makes c G [12/9-yne^"'''"7„(m + 1)6, oo). 



Reason: Obviously c" 



0+ and c — > oo in this case. However 



Case4 



/3 + 1 - n < 



and 



H{a, S) < 1 Let / G and f7 C i?" such that for any x in J7 and any 



6o > there is a cube E of side 6o satisfying x G £^ C fj. Let ft be as in (1) with n + j3 > 1 or 
n + /3 = —1. For any fixed ^ > in Theoreml.4, the larger c is, the better it is. 



Reason: H{a,S) < 1 implies H{a,S) = for some 77 < 0. Then c * • [H{a,S)Y 
as c — >■ 00. 







CaseS 



(3 + 1 







and 



iJ(cr,(5) > 1 



Let / e Ba and C i?" such that for any x in 51 and any 
60 > there is a cube E of side bo satisfying x G E C ft. Let h be as in (1) with n + /? > 1 or 
= —1. Foranyfixed5 > in Theoreml.4, the optimal choice of c is to let c = 12py^e^"'''"7„(m+l)(5. 



Reason: In this case c * [-f^(c, 6)Y = [H{a, 6)Y which increases as c increases. The requirement 
S < 60 tells us that c e [12pv^e^"'''"7„(m + l)i5, 00). Hence we choose c = 12pv^e^"'''''7„(m + 1)6. 

Remark: In Casc5 it should be noticed that when c = 12py^e^"'^"7„(TO+ 1)^, c^[H{a,6)r>l 
and is not very small. The error bound (9) may not be very satisfactory. Also, in Case4 and 5 we 
excluded the case H{a, 6) = 1 because it rarely happens. 



Case6 n = 1 and 







Let f G Ba and f2 C i?" such that for any x in f2 and any 60 > there 

is a cube E of side ha satisfying x E E C il. Let h be as in (1) with n = 1 and /3 = — 1. For any 
fixed < 5 < —rr — - in Theoreml.4, the suggested value of c is as follows. 

/ .. - 

Let rj 



r. Then 



(a) if 77 + § < 0, the larger c is, the better it is; 
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(b) a T] + ^ > 0, choose c = ^f^^iX^) whenever ^^^2.) ^ ^ ^^^d choose c = ^ whenever 
1 ^ i 

4(r)+f) ^ <T- 

Reason: The requirement (5 < Jo leads to c e [12py^e^"'''"7„i5, oo). In CaseS of section2 when (A)? 
was ignored, the- suggc^stcd value of c is ^. Hence we put here the restriction 12p^/ne'^"'^'^'ynS < ^, 
i.e. <S < ,„ J-.,,. . 

Now the crucial part of (12) is (A)? • {d±^y where 



3 J \3 J ^ ' eM'' 

and is decreasing for c € (0, oo). By the reasoning of CaseS of scction2, the suggested value of c 
when (A) J is ignored is c = i. It's obvious that c € (0, i) should be excluded when (A)''' is taken 
into consideration. The crucial part of (12) is then (A)^ • H2 (c) where H2{c) := as in CaseS 
of section2. Now 



(A)7Vl2(^<e'=''-^ 



j^ll/lll + ^r(i)^e=ni/lli'"' 



whose essential part is 



G(c) := e^" • ^ • (ca)i • • ||/||2 = ^ • e^^+t)^ • •||/||2. 

If?7+f < 0, G(c) is decreasing. Ifr;+f > 0, on [i, 00), G"(c) = ai-c-^ •e(''+t)'=-[-i+c(r/+f )]||/||2 
It gives that G'(c) = iff c = c* := ^{^^s.-^ ■ If c* > ^, the suggested value of c is naturally 

If c* < ^, the suggested value of c is |^ since G(c) is increasing on 00). 

Remark: In 3.2 we avoided letting the side length 60 — >■ because decreasing bo will only make the 
error bound worse. 



4('?+f) 



As a final conclusion, we would like to point out an important fact. Although the approximated 
functions dealt with in this paper are required to be band-limited, it's in fact not very restrictive. A 
lot of functions are numerically band-limited even though they are not theoretically band-limited. 
As long as the Fourier transform /(^) decays to zero very fast as |^| 00, / will be numerically 
compactly supported and / numerically band-limited. There are a multitude of such functions. For 
example, multiquadrics and Gaussians are themselves numerically band-limited. 

In any case, non-band-limited functions are important and should be treated in a rigorous way. 
For this purpose we need an approach different from this paper. The results will appear in a 
forthcoming paper of the author. 
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